Spin based heat engine: demonstration of multiple rounds of algorithmic cooling. 
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We show experimental results demonstrating multiple rounds of heat-bath algorithmic cooling in 
a 3 qubit solid-state nuclear magnetic resonance quantum information processor. By dynamically 
pumping entropy out of the system of interest and into the heat-bath, we are able show purification 
of a single qubit to a polarization 1.69 times that of the heat-bath and thus go beyond the Shannon 
bound for closed system cooling. The cooling algorithm implemented requires both high fidelity 
coherent control and a deliberate controlled interaction with the environment. We discuss the 
improvements in control that allowed this demonstration. This experimental work shows that given 
this level of quantum control in systems with sufficiently large polarizations, nearly pure qubits 
should be achievable. 

PACS numbers: 03.67.Lx, 76.60.-k. 



Using quantum mechanics to process information 
promises the possibility to dramatically speed-up certain 
computations and simulations [ij. Many experimental 
paths are being pursued in the goal of coherently ma- 
nipulating quantum systems 0- The standard circuit 
based model has certain experimental criteria Q : one of 
which is the ability to initialize pure fiducial quantum 
states. This is needed not only to create the initial state 
for many quantum algorithms, but it is also necessary to 
have pure qubits on demand throughout the computa- 
tion in order to compute fault-tolerantly in the presence 
of errors However, many physical implementations 
are able to initialize only mixed states with a certain bias 
towards the desired state. In these cases it will almost 
certainly be necessary to run some protocol to purify the 
qubits. Aside from quantum information purposes, the 
ability to increase the bias of nuclear spins is fundamen- 
tally important in nuclear magnetic resonance (NMR) 
where small signal to noise ratios are usually overcome 
with signal averaging. A boost in the initial bias by a 
factor b would reduce the experiment time by b^. 

A potential solution is algorithmic, whereby a series of 
logic gates can lower the temperature of a subset of the 
qubits. If the relaxation rate back to thermal equilibrium 
(Ti) is sufficiently longer than the cooling operations, 
then it is possible to cool a subset far below their thermal 
equilibrium bias. This algorithmic cooling is essentially 
classical and is based on early work from von Neumann 
0. If the bits start with some bias e, so the probability of 
being in the state or spin up is P| = and Pi = , 
then the application of a logic gate can compress the 
uncertainty into some fraction of the qubits and increase 
the bias on the rest. Using these ideas it was shown 
that by starting with a sufficient number of qubits, it is 
possible to initialize a small number of qubits to a fiducial 
state with near certainty [1,|3|- However, for the starting 
biases typical of room temperature NMR, that sufficient 



number is an impractically large number e.g., to purify 
only one qubit requires « 10^^ spins. In a closed system, 
the compression step is limited by the Shannon bound: 
the total entropy of the system is conserved. The level of 
purification is usually further limited if the compression 
step is restricted to unitary transformations [8[. As a 
relevant example, with three qubits, each starting with 
the same polarization e, it is not possible to amplify the 
bias of one qubit to more than 1.5e. 

If; on the other hand, we consider an open system, and 
allow the ability to pump entropy out of the system in 
a controlled manner, then we can surpass the Shannon 
bound. Suppose that some of the qubits have a fast re- 
laxation time and quickly return to equilibrium with the 
heat-bath. Every compression step cools some subset of 
qubits and heats up the remainder of the qubits above 
the heat-bath temperature. If these heated qubits are 
then allowed to relax back to the heat-bath temperature, 
the total entropy of the qubit system has decreased. The 
cooling algorithm then consists of alternating rounds of 
cooling and compression [1, [13, U, Recently Schul- 
man et al. [ist have shown an optimal algorithm, the 
partner pairing algorithm (PPA) , for the scenario of hav- 
ing one special purpose reset qubit. This optimality also 
allowed them to show a crucially important threshold ef- 
fect: given n qubits and a heat-bath bias of e ^ 2~" 
then it is possible to almost perfectly purify the system 
with resources growing polynomially in n; whereas, if 
e <^ 2~", the maximum bias achievable on one qubit is 
e2"~^ A similar system with differential relaxation 



rates has been considered for error correction purposes 
and could also be used for purification [l5| . Several parts 
of the cooling algorithms, including both the compression 
step and the reset [l3|, have been experimentally 
demonstrated using NMR quantum information proces- 
sors (QIP). These were combined by Baugh et al. 
to show one round of cooling three qubits and the com- 



pression step. However, sufficient control was lacking to 
demonstrate multiple rounds of cooling and compression. 
Here, we present experimental results showing multiple 
rounds of resetting and compression steps allowing us to 
go beyond the Shannon bound for the first time. 

NMR offers one of the most advanced implementations 
of a QIP with high fidelity control and several qubits [l^ . 
The qubits are nuclear spins in a bulk ensemble sam- 
ple where many, ideally identical, copies of the processor 
are manipulated in parallel. Readout consists of measur- 
ing the expectation value of operators averaged over the 
sample. A large static magnetic field provides the quan- 
tization axis and for spin 1/2 nuclei, two Zeeman energy 
levels. In thermal equilibrium at room termpature there 
is a very small bias or polarization which the algorithmic 
cooling circuit can amplify. 

The majority of previous work in NMR QIP has fo- 
cussed on liquid state systems that have a simple system 
Hamiltonian and good coherence properties. Solid state 
systems are more difficult to control in practice but offer 
intrinsically longer coherence times, the ability to pump 
entropy out of the system of interest into a spin bath 
and the potential for much higher initial polarizations. 
The specific system used here is a three qubit proces- 
sor molecule, malonic acid [2^. The sample is a macro- 
scopic single crystal, where a small fraction 3%) of the 
molecules are triply labeled with ^^C to form the proces- 
sor molecules. The 100% abundant protons in the crystal 
form the heat-bath. A proton-decoupled ^^C spectrum 
is shown in Fig. [TJ An accurate natural Hamiltonian is 
necessary for high fidelity control and is obtained from 
precise spectral fitting. The spectrum is simulated from 
the evolution of the natural Hamiltonian, and the Hamil- 
tonian parameters (chemical shifts, dipolar couplings and 
the much weaker J couplings, which are usually ignored in 
the solid-state) are then varied to optimize the fit through 
a least squares minimization. The control pulses are de- 
signed to be robust to the large uncertainty (« 150Hz) 
in chemical shift and are fortuitously robust to the much 
smaller uncertainties (< lOHz) in the coupling results. 

The experiment consisted of four rounds of cooling and 
compression. The quantum circuit implemented is shown 
in Figure [21 The carbon register is initialized to infinite 
temperature by dephasing the thermal polarization. The 
bulk polarization was then rotated into the plane and 
fixed in place with a r.f. spin locking pulse. Selective 
transfer of the polarization from Hmi,2 to Cm served as 
the refresh step (vide infra) . During the spin locking pe- 
riods, which also serve to decouple the protons during 
the carbon-carbon operations, the proton dipolar cou- 
pling network still allows for spin diffusion. Thus, after 
the refresh H„ii,2 are cooled by contact with the rest of 
the proton bath and return to the heat-bath tempera- 
ture prior to the next refresh step. The polarization on 
Cm is swapped onto Ci or C2 with a carbon control se- 
quence. Once the heat-bath polarization is built up on 
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FIG. 1: The proton decoupled ^^C spectrum of malonic acid 
in the orientation used in the experiments. The experiments 
were performed in a static field of 7. IT using a purpose- 
built probe. Also shown is the molecule and the Hamilto- 
nian parameters (all values in kHz). Elements along the di- 
agonal represent chemical shifts with respect to the trans- 
mitter frequency (with the Hamiltonian "^^niJial ). El- 
ements below the diagonal are dipolar coupling constants 
(X]i<j f (2o"!,(T^ — cr'crj — ayGy^) and above the diagonal 
are J coupling constants (^;^j f Jij (o"zO"z + ""i""!- + ""y'^y))- 
The ^''C-^^C values are obtained from the spectral fit. The 
relative peak heights give us information about the relative 
strengths of the dipolar and the indirect J-couplings. The 
three central peaks of each multiplet are from the natural 
abundance of ^^C present in the molecule at ~ 1%. Combin- 
ing the fitting information with crystal structure data from 
neutron scattering experiments [2l[ gives the orientation of 
the molecule with respect to the static magnetic field and 
from that the proton-carbon dipolar couplings. 



all three spins, the polarization is then compressed onto 
C2 ■ C2 has the smallest proton-carbon coupling and so is 
least affected by errors during the decoupling and refresh 
steps and is best able to store the polarization. Ideally, 
this first compression step should boost the polarization 
of C2 to 1.5X the heat-bath polarization and reduce C1/3 
to 0.5X (end of Step 1 in Fig [2]). Subsequent steps in- 
volve returning Cm and Ci to the heat-bath temperature 
and repeating the compression step. In this limit of the 
heat-bath polarization e <C 2~", the polarization on C2 
will asymptotically approach 2e [l^ . 

The refresh step is achieved by selectively transferring 
polarization from the methylene protons Hmi,2 to the 
adjacent carbon Cm- Heteronuclear polarization trans- 
fer can be achieved through multiple pulse techniques 
or cross polarization (CP); here we used CP because 
it was better able to preserve the heat-bath polariza- 
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FIG. 2: The quantum circuit implemented (see text) with the ideal polarizations noted in terms of the heat-bath polarization 
e. Each set of swap and compression gate is considered a step and the ideal polarization on the target qubit C2 should increase 
as 1.5,1.75,1.88,1.94 in steps 1 through 4. The refresh operations swap polarization from Hmi,2 to Cm with a short contact CP. 
The thermal contact between Hm.1,2 and the rest of the proton bath takes place during the spin locking decoupling pulse for 
the duration of the carbon register operations. The swap gates are 1.6ms and the compression gate, 2.2ms. The compression 
gate is equivalent to a permutation of the diagonal elements of the density matrix and one possible implementation is shown 
decomposed as C-NOT-NOT and Toffoli gates however, it was implemented as a single GRAPE pulse. The bottom trace 
shows the amplitude of the radio frequency control fields for the pulse sequence. The inset shows in detail the two quadrature 
components of one of the GRAPE control pulses which implements a unitary swap gate between qubits 1 and 3. 



tion. Radio frequency fields drive two spin species at 
the same nutation frequency (Hartman-Hahn matching 
condition) which allows them to exchange polarization 
and their spin temperatures to equalize. During initial 
contact the polarization may coherently oscillate between 
strongly coupled proton and carbon spins because, 
for the relevant input states, the CP condition gives an 
exchange Hamiltonian. Thus, if we apply a very short 
CP pulse, we can selectively swap the polarization from 
Hmi/m2 to Cm whilc negligibly affecting the much more 
weakly coupled Ci and C2. Experimentally we found we 
could increase the polarization on Cm by 3.3X, similar to 
the enhancement from conventional CP (the theoretical 
maximum is 3.98X). When a refresh step was required, 
the proton spin locking power was smoothly reduced over 
10/iS to the Hartman Hahn matching condition for 25/iS 
and then smoothly returned to high power. It should 
be noted that although CP is the most common method 
for polarization enhancement of rare spins, it is not the 
most efficient. In certain cases, adiabatic demagnetiza- 
tion may be able to boost the polarization of the rare 
spins above the heat-bath bias [23j . 

The carbon control pulses are optimal control se- 
quences implementing unitary quantum gates even 
though the PPA requires only classical gates that per- 
mute the diagonal elements of the density matrix. The 
pulses (see Fig. [5]) are numerically optimized using the 



GRAPE algorithm - starting from a random guess 
the pulse is itcratively improved through a gradient as- 
cent search. In bulk ensembles there are inevitable dis- 
tributions of control parameters across the sample. In 
the current case these cause incoherent loss (Tj* w 2ms 
) a, t a much faster rate the the intrinsic T2 « 100ms 
[20|. In the present work the most important distribu- 
tions are the static magnetic field and the r.f. control 
field. In order to obtain high experimental fidelities, it 
was important to demand that the pulses apply the same 
unitary gate across a range of static fields and pulsing 
powers. The GRAPE pulses were numerically optimized 
to have a fidelity (|ir(t/J^^;C/^,™)| V22") of above 0.9975 
averaged over a distribution of ±5% in r.f. amplitude 
and zblSOHz in static field. Although the inhomogenities 
here are specific to ensemble systems, the utility of ro- 
bust control will be applicable in other single quantum 
systems for miscalibration, and uncertainty or slow drift 
in the Hamiltonian. The pulses were also corrected for 
non-linearitcs in the pulse generation and transmission to 
the sample through the use of a simple feedback circuit 
which measured the r.f. field at the sample and corrected 
the pulse accordingly. The most important element for 
experimentally achieving high fidelity control was to en- 
sure that the control fields were within the bandwidth 
of the hardware. The finite bandwidth of the circuitry 
produces distortions in both the amplitude and phase of 
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the pulse at switching points [25[. The solution is to use 
only smoothly varying control fields. Although limiting 
the bandwidth of the optimal control pulses may lead to 
longer than time-optimal pulses, incoherent sources of de- 
coherence can still be refocussed and higher experimental 
fidelities result. 
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FIG. 3: Table of tlie measured polarization (with respect to 
tlie polarization after the initial refresh step) of each spin 
after the compression gates (steps 6,10,14,18 in the PPA). 
All results are ±0.02. For the final compression step the 
heat-bath polarization is no longer needed which allows a 
switch from the spin locking c.w. decoupling to the more 
efficient SPINAL64 [2^ (without the switch the enhancement 
is 1.67X). The spectra show a comparison of the the first 
refresh step (swapped to C2) and the final signal after four 
compression steps. There is a clear boost of signal on C2, and 
also substantial polarization on Ci and Cm- The distortions 
in the spectrum evident for Ci and Cm are due to residual 
natural abundance ^"^C signal. 



With these improvements in control we were able to 
maintain the heat-bath polarization of the proton-spin 
system and implement repeated rounds of cooling and 
compression. The polarization increased for up to four 
compression steps. At that point, the polarization of C2 
is 1.69e which is well above the Shannon bound of 1.5e. 
Furthermore, we have built up a non-negligible polariza- 
tion on the other two qubits of 0.84e and 0.79e increasing 
the total information content [l3| of the system (see [sH). 

Our control is now limited by two factors. During the 
carbon control sequences, the protons are decoupled by 
the spin locking pulse. This is equivalent to c.w. decou- 
pling which has long been recognized as giving poor de- 
coupling bandwidth as a function of the decoupling power 
(limited by hardware constraints), particularly if the de- 
coupled spins have strong dipolar couplings as is the case 
here. Unfortunately, more efficient decoupling techniques 
such as SPINAL64 [26[, do not preserve the magnetiza- 
tion of the decoupled spins which is necessary for this 
experiment. We are also limited by the non-ideality of 
the heat-bath: the proton system is a finite size and so 
every refresh step heats the bath. This amount is roughly 



calculated as the ratio of the number of carbons to pro- 
tons. Given our 3% labeling {^^CsHiOi) this is - 0.5%. 
Furthermore, there is relaxation during the spin-locking 
pulses (Ti in the rotating frame. Tip) so that our heat- 
bath is gradually warming during the experiment. 

This experiment represents a step towards creating 
pure qubits in systems where we have imperfect initial- 
ization. Here we have demonstrated that with sufficient 
control multiple rounds of cooling and compression can 
be achieved and the optimal control applied here should 
be applicable in other QIP systems. Future work will 
concentrate on starting with a reset step that has a suffi- 
ciently high polarization. Clearly once errors are consid- 
ered, perfectly pure qubits are no longer possible. These 
experiments, tog ether with our recent work on error char- 
acterization [27[, suggest an error per gate of approxi- 
mately 1%. As noted above, this is largely limited by 
incomplete proton decoupling, a problem specific to this 
system, and not the control techniques themselves or de- 
coherence. Even with an error model of a depolarizing 
rate of 1% per gate, simulations suggest that with 3/5 
qubits, close to pure qubits with polarizations above 97% 
are possible with reset polarizations of only 87%/81%. 
Complete plots of the above threshold scaling behavior 
are available in Ref. [s^ . These polarizations and num- 
ber of controllable qubits are within reach in a variety of 
electron- nuclear systems 28, 2^. For example, nitrogen 
vacancy electronic centers in diamond can be optically 
pumped to ~ 80% [131, or the thermal bias of electron 
spins (g w 2) at cryogenic temperatures and typical fields 
of a few Tesla provides sufficient polarization. 
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FIG. 1: To show the purification of the entire system, the plot shows the information content (the maximum entropy minus 
the entropy in units of /InA [1]) of the carbon register. If all the qubits were brought to the heat-bath polarization (standard 
CP) the information content would be 3. However, using multiple rounds of the heat-bath algorithmic cooling scheme allows 
us to surpass this threshold. The decrease in information content during carbon control sequences represent decoherence and 
pulse imperfections; however, the drops after steps 6,10,14,18 also represent some of the information content being stored in 
unmeasured classical correlations (i.e. azCT^CT^). In the case of three qubits, these correlations decrease exponentially with the 
number of PPA steps. 
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FIG. 2: Plot showing the maximum achievable polarization for a given reset polarization using the PPA algorithm for 3 (a) or 5 
(b) qubits. A reasonable error model is a depolarization channel applied after every control gate. Even if the error model is not 
depolarizing it can be made so through explicit randomization. Shown on the plots are the maximum achievable polarizations 
for certain levels of errors per gate. Even with errors, large boosts in polarization are possible and with realized control levels, 
polarizations above 97% should be achievable. 



[1] G. Brassard, Y. Ellas, J. M. Fernandez, H. Gilboa, J. A. Jones, T. Mor, Y. Weinstein, and L. Xiao, arXiv pp. arXiv:quant- 
ph/0511156vl (2005), URL http://www.arxiv.org/abs/quant-ph/0511156. 



